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^ ■ Abstract 

In this paper we study a broad class of structured nonlinear programming (SNLP) 
problems. In particular, we first establish the first-order optimality conditions for them. 

■ Then we propose sequential convex programming (SCP) methods for solving them in 

■ which each iteration is obtained by solving a convex programming problem exactly or 
, inexactly. Under some suitable assumptions, we establish that any accumulation point 

of the sequence generated by the methods is a KKT point of the SNLP problems. In 
addition, we propose a variant of the exact SCP method for SNLP in which nonmonotone 
scheme and "local" Lipschitz constants of the associated functions are used. And a 
J> ■ similar convergence result as mentioned above is established. 

m ■ 

■ Key words: Sequential convex programming, structured nonlinear programming, first- 
I order methods 

d 

: 1 Introduction 

In this paper we consider a class of structured nonlinear programming problems in the form 

X: of 

■ min f (x) + p{x) — u{x) 

s.t. gi{x) + qi{x) - Vi{x) <0, i = l,...,m, (1) 

X e X, 

where X C 9fJ" is a nonempty closed convex set, /, gi's are differentiable in X, and p, u, g^'s, 
Vj's are convex (but not necessarily smooth) in X. 

Throughout this paper we make the following assumption. 
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Assumption 1 The gradients of f and Qi 's are Lipschitz continuous in X with constants 
Lf > and Lg- > for i = 1, . . . ,m, that is, 



||V/(x)-V/(y)|| < Lf\\x-yiyx,yeX, 

\\Vgiix) -\/gi{y)\\ < Lg^\\x - y\\, \fx,y e X, i = 1, . . . ,m. 



Some special cases of problem ([T]) have received considerable attention in the literature 
(see, for example, [HI El IHl EDI [221 [H [El [H]). In particular, Nesterov [IS] and Beck and 
TebouUe [3] considered a special case of (JT]) with m = 0, u = and / being smooth convex with 
Lipschitz continuous gradient, and they proposed accelerated gradient methods for solving it. 
Tseng and Yun [20], Wright et al. [22], and Lu and Zhang [H] proposed efficient first-order 
methods for the similar problems as studied in [3l [I5] with / being smooth but not necessarily 
convex. Recently, Auslender et al. [Ij studied another special case of ([H), where X = 3?", 
p = 0, u = 0, qi = 0, Vi = for all i, and / and gi^s are smooth with Lipschitz continuous 
gradient. They proposed a gradient-based method so called the moving balls approximation 
(MBA) method for solving the problem. Very recently. Hong et al. [12] studied a sequential 
convex programming (SCP) approach for solving a special case of ([T]) with m = 1, / = 0, 
gi = 0, and p, u, qi, Ui being smooth convex functions in X. In addition, a broad subclass 
of ([1]) with m = 0, / = 0, known as DC (difference of convex functions) programming, was 
extensively studied and efficient first-order method was proposed for it (see, for example. 



Recently, a class of nonlinear programming models were widely used for finding a sparse 
approximate solution to a system or a function. They can also be viewed as special cases of 
(fl]). In particular, they are in the form of 



where I is a loss function, Q C 9fJ" is a nonempty closed convex set, and h : 9?+ — )■ 9?_|_ is 
a sparsity-induced penalty function. Some popular /I's used in the literature are listed as 
follows: 



mm)- 



n 




(2) 



i=l 



(i) (/i penalty [13 El [5]): h{t) 



Xt \/t > 0; 



fXt if < t < A, 
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where A>0, 0<g<l, a>l, ?7>0 and e > are parameters. One can observe that 
the above /I's are monotonically increasing functions in [0, oo). Moreover, At — h{t) is convex 
in [0, cxd) (see [9j). It imphes that u{y) = ^"=i(Aj/j — hijji)) is convex in 9ft". Using the 
monotonicity of /i, we can see that ([2]) can be equivalently reformulated as 

n 

min{/(x) + h{yi) : y > \x\,x E ^l}. 
1=1 

Further, by using the definition of u, we observe that ([21) is equivalent to 

min{/(a;) + A||y||i — u{y) : y > \x\,x E Q}, 

which clearly is a special case of with X = {{x,y) : y > \x\,x G Q}. 

In this paper we provide a comprehensive study on problem ([T]). In particular, we first 
establish the first-order optimality conditions for ([1]). Then we propose SCP methods for 
solving in which each iteration is obtained by solving a convex programming problem 
exactly or inexactly. Under some suitable assumptions, we establish that any accumulation 
point of the sequence generated by the methods is a KKT point of ([I]). In addition, we 
propose a variant of the exact SCP method for ([T]) in which nonmonotone scheme and "local" 
Lipschitz constants of the associated functions are used. And a similar convergence result as 
mentioned above is established. 

The outline of this paper is as follows. In Subsection 11.11 we introduce some notations 
that are used in the paper. In Section [2] we establish the first-order optimality conditions for 
problem ([T]). In Section [3] we propose an exact SCP method and its variant for solving ([T]) 
and establish their convergence. Finally, in Section H] we propose an inexact SCP method for 
solving ([1]) and study its convergence. 

1.1 Notation 

Given a nonempty closed convex Q C 3?"-, cone(f2) denotes the cone generated by Q. Given 
an arbitrary point x E Q, A/'n(x) and Tn{x) denote the normal and tangent cones of fl at 
X, respectively. In addition, dist(?/,fi) denotes the distance between y E and Vt. For a 
function /i : f2 — )• 3ft, c? G 3ft" and x eVL, h'{x; d) is the directional derivative of /i at x along d. 
For a convex function h, dh{x) denotes the subdifferential of h at x. Finally, given any t G 3ft, 
we denote its nonnegative part by t^, that is, = max(t, 0). 

2 First-order optimality conditions 

In this section we establish the first-order optimality conditions for problem ([T]). Given any 
X E X, the set of indices corresponding to the active constraints of (II]) at x is denoted by 
A{x), that is, 

A{x) = {1 < i < m : gi{x) + qi{x) — Vi{x) = 0}. 
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Theorem 2.1 Suppose that x* is a local minimizer of problem ([T]). Assume that the cone 

coTie{Vg,{x*) + dq,{x*)-dv,{x*))+Ux{x*) (3) 

is closed, and moreover, there exists d G Tx{x*) such that 

g[{x*;d) + q'i{x*;d) - inf s'^d < 0, Vi e Ar{x*), (4) 

where 

Arix*) = {iE A{x*) : g[{x*; d) + q[{x*] d) - v[{x*] d) = Q for some O^de Txix*)}. (5) 
Then, there exists A* G 3?"* together with x* satisfying the KKT conditions 

m 

G V/(x*) + dp{x*) - duix*) + E KN9^ix*) + - + A/'a-(x*), 

A* > 0, \*[gi{x*) + q,{x*) - Vi{x*)] =0, z = l,...,m. 

Proof. For convenience, let 

A = -^f(x*)-dp{x*) + du{x*), 

B = J2 cone{V gi{x*) + dqi{x*) - dvi{x*)) +J\fx{x*). 

i&A{x*) 

In view of the assumption, one can observe that A and B are closed convex sets. We first 
show that A n S 7^ 0. Suppose for contradiction that ^4 fl 5 = 0. It then follows from the 
well-known separation theorem that there exists 7^ G 3?" such that 

infrf^s>l, supd^s<0. (6) 

s&A gfzB 

By the definition of A and the first inequality of ([6]), one has 

f'{x*;d) + p'{x*;d) - u'{x*;d) = rf^V/(x*) + sup d^s- sup d'^s 

< sup(-rf^s) < -1 < 0. ^ ' 

s<=A 

In addition, it follows from the definition of B and the second inequality of (|6]) that d G 
iAfxix*)y = Txix*) and 

sup{ci^s : s G Vg^ix*) + - dvi{x*)} < 0, Vi G A{x*), 

which implies that 

gl{x*;d) + ql{x*;d)-vi{x*;d) < 0, G ^(x*). 

4 



Since d G Tx{x*), there exist a positive sequence {tk} 10 and a sequence {x^} C X such that 
x'^ = X* + tfcc/ + o(tfc). We next consider two cases to derive a contradiction. 

Case 1): Suppose that g'i{x*; d) + q[{x*] d) — v[{x*] < for all i G A{x*). It then follows 
that for every i G A{x*), 

gi{,x^) + - Vi{x^) = gi{x'') - gi{x*) + qi{x'') - qi{x*) - [vi{x^) - Vi{x*)], 

= tk[gl{x*;d) + ql{x*;d)-v[{x*-d)]+oitk) < 

when k ^ 1. Hence, x^ is a feasible point when k is sufficiently large. Using ([7]) and a similar 
argument as above, we have 

f{x'') + p{x^) - u{x^) < f{x*) + p{x*) - u{x*) 

for all sufficiently large k. In addition, notice that — )■ x* as — ?■ oo. These results imply 
that X* is not a local minimizer, which is a contradiction to the assumption. 
Case 2): Suppose that there exists some iq G A{x*) such that 

9'iS^*\ d) + g-„(x*; d) - v-^ix*; d) = 0. 

It then together with ([5]) implies that io G Ar{x*). By the assumption, there exists 7^ 
d G Tx{x*) such that (jlj) holds. Since d E Tx{x*), there exist a positive sequence {rji} i 
and a sequence {y''} C A" such that = x* + ?7iJ + 0(77/). Let d} = {y'' — x*)/rji. Clearly, 
||c? — d\\ = 0(1). It follows that for all i, 

g[{x*-i)-g[{x*-d)+q[{x*-d')-q[{x*-d)-[ inf s^d'- inf s^J] = 0(|| J' - J||) = o(l), 

which together with (jlj) implies that for sufficiently large Z, 

g[{x*]i) + q[{x*]d^)- inf s^(?<0, G ^r(a;*). (8) 

s(idvi{x*) 

Let C (0, 1] be a sequence such that ai J, 0, and let 

c?' = (1 - + aidK 

Claim that for sufficiently large /, 

g[{x*- S) + q[{x*- d^) - v[{x*- d^) < 0, G ^(x*). (9) 
Indeed, we arbitrarily choose i G ^(x*). If g'i{x*] d) + q[{x*; d) — f -(x*; d) < 0, we then have 
lim g'iix*; d) + g-(x*; - v[{x*] = g-ix*; d) + g-(x*; d) - v[{x*; d) < 0, 

which immediately implies that ([9]) holds for sufficiently large /. We now suppose that 

g[{x*-d) + q[{x*-d)-v[{x*-d)=0. (10) 
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Hence, i G Ar{x*). Let s* G Arg max{s'^(i : s G dvi{x*)}. Using (|8]), (fTOj) . convexity, and the 

s 

definition of {d^}, we have 
g'i{x*;d^) + q'i{x*;d^)-vl{x*;d) 

< (1 - ai)g'i{x*; d) + (?) + (!- d) + d^) - - a^rf + aid^] 

= (1 - c?) + - ^.'(a;*; d)] + aJ^^Ka;*; rf') + q[{x*- - {s^Yd'] 

= ai[g[{x*] d}) + q[{x*] (?) - < a«[c/,'(x*; (?) + q[{x*] (?) - inf s^(?] < 0, 

se<9?Ji(x*) 

and hence ([9]) again holds for sufficiently large /. Now let the sequence {x^''} be defined as 

x^'' = (1 - ai)x^ + ai{x* + tfcd'), Vfc, / > 1. (11) 

By the definition of c?, one can observe that x* + t^t? ^ for sufficiently large k. It then 
follows that for each /, x^'^ G X when A; ^ 1 due to x'^ G A" and convexity of X. Recall that 
x^ = X* + tkd + o{tk), which together with fllip yields 



X' 



fc,, 



X* +tkd^ + o{tk). 



Using this relation and iQ, one can obtain that, for any i G A{x*) and sufficiently large /, 

giix'''^) + qi{x^'^) - Vi{x^'^) = gi{x'''^) - gi{x*) + qi{x^^^) - qi{x*) - [vi{x'''^) - Vi{x*)], 

= tk[g'iix*;d^) + q'iix*;d^)-v'i{x*;d^)]+o{tk) <0 

whenever k > rii for some sequence {ni}. Hence, x^''' is a feasible point for k > rii and 
sufficiently large /. Using ([7]) and the fact c?' — )■ c? as Z — )■ oo, we know that 

f'{x*;d^)+p'{x*;d^)-u'{x*;d^) < 0. 

Using this relation and a similar argument as above, we obtain that for sufficiently large I, 

/(x^-') + p(x^'') - m(x'='') < fix*) + p{x*) - uix*) 

whenever k > ni for some sequence {ni}- Notice that x^'' — > x* as /c, / — ?■ oo. The above results 
again contradicts with the assumption that x* is a local minimizer. Therefore, A (1 B ^. 
The conclusion of this theorem then immediately follows from this relation and the definitions 
of A and B. m 

Remark. 

(a) Condition (|3]) is satisfied if A" is a polyhedron and ^ cone{'Vgi{x*)+dqi{x*)—dvi{x*)) 
is a finitely generated cone or if 

J2 cone(V(7i(x*) + %(x*) - dvi{x*)) nUx{x*) = {0}. 
ieA(x*) J 

It thus follows that, if A" is a polyhedron and qi and vi are differentiable or piecewise 
convex functions (e.g., ||x||i) for each i G ^(x*), condition ([3]) holds. 
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(b) When / and (?i's are convex, condition (jl]) holds if there exists a generahzed Slater point 
X G A", that is, x satisfies 

gi{x) + qi{x) — Vi{x*) — inf s'^{x — x*) < 0, Vi G A{x*). 

Indeed, let J = x — x*. Clearly, d E Tx{x*). Moreover, for each i G A{x*), 

g'i{x*; d) + q'iix*; d) - inf s^d < gi{x* + d) - gi{x*) + qi{x* + d) - qi{x*) + Vi{x*) 

- Vi{x*) - inf s^(x - X*), 

s£dvi{x*) 

= gi{x) + qi{x) — Vi{x*) — inf s'^{x—x*) < 0, 

and hence condition (jl]) holds. 

■ 

3 Exact sequential convex programming method 

In this section we propose an exact sequential convex programming (SCP) method for solving 
problem ([1]) in which each iteration is obtained by solving exactly a convex programming 
problem. We also propose a variant of it for solving ([1]). Before proceeding, we introduce 
some notations that will be used subsequently. 

For each x E X, sj, Su, Sg., s^- G 3?*^ for i = 1, . . . , m, we define 

|s,J,=i, |s.J,=J - |y G ^ . ^ ^^^^^ - x)] < J ' ^^^^ 

h{y;x,Sf,Su) = f{x) + sj{y - x) + ^\\y - x\\^ + p{y) - [u{x) + sl{y - x)]. 

In addition, we denote by J-" the feasible region of problem ([1]). 

We are now ready to present an exact SCP method for solving problem ([1]). 

Exact sequential convex programming method for 

Let x° G J-" be arbitrarily chosen. Set k = 0. 

1) Compute = V f{x^), G du{x^), = V(?i(x*^), s^. G dvi{x'^) for all i. 

2) Solve 

x^+i G Argmm{/^(y;x^4,s^) : y G C(x^ {^J™ i, (13) 

3) Set <(— + 1 and go to step 1). 
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end 



Remark. 

(a) When X = p = 0, u = 0, Lj > 0, qi = 0, Vi = and Lg- > for all i, the above 
method becomes the MBA method proposed in [1]. 

(b) When m = 1, f = 0, gi = 0, and p, u, qi, Ui are smooth convex functions in X, the 
above method becomes the method studied in [12]. 

(c) When m = and / = 0, the above method becomes the well-known method fi8[ [T3] for 
DC programming. 

■ 

In what follows, we will establish that under some assumptions, any accumulation point 
of the sequence {x*^} generated above is a KKT point of problem ([1]). Before proceeding, we 
state several lemmas that will be used subsequently. 

The following lemma is well known (see, for example, [16]), which provides an upper bound 
for a smooth function with Lipschitz continuous gradient. 

Lemma 3.1 Let f2 C 3fJ" &e a closed convex set, and h a differentiahle function in Vt. Suppose 
that there exists some constant Lh > such that 

||V/i(a;) - V/i(i/)|| <Lh\\x-y\\, Wx,yen. 

Then, for any L > Lh, 

h{y) < h{x) + Vh{xY' {y — x) + —\\y — x\\'^ , \lx,y&Vt. 

The following lemma is due to Robinson [17J, which provides an error bound for a class of 
convex inequahties. 

Lemma 3.2 Let X he a closed convex set in 3?", and K, a nonempty closed convex cone in 
3?™". Suppose that g : X 3?™ is a K,- convex function, that is, 

Xg{x^) + (1 - X)g{x^) e g{Xx^ + (1 - X)x^) + K. 

Assume that x'^ E X is a generalized Slater point for the set f2 := {x G X : G g{x) +1C}, that 
is, there exists 5 > such that i3(0; 5) C g{x^) + K, where B{Q] 5) is the closed hall centered 
at with radius 5. Then, 

dist(x,fi) < r^||x-x"||dist(0,^(x) + /C), Vx e X 
The following lemma states a simple property of the set C that is defined in (fT2|) . 
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Lemma 3.3 For each x G J-", letSg^ = Vgi{x) and G dvi{x). Then, {sg.}™,;^, {s^-}^]^) 
is a nonempty closed convex set in T . 

Proof. Since x G J-", one can clearly see that x G C{x, {sg-}^i, {svi}iLi)- Hence, C{x, {sg^}^i, 
{s^,.}^]^) 7^ 0. Due to s^i G dvi{x), we know that Vi{y) > Vi{x) + s'^.{y — x),Vy G 3?"". Us- 
ing this relation and Lemma ISTTI one can see that for any y G C{x, {Sg.}^^, {Sy.}'^i), y 
is in X and (^id/) + — Vi{y) < for i = l,...,m. Hence, y & J^. It implies that 
{sc,.}^]^, {s^.}™ J C J^. Finally, it is easy to see that {s^-}™ ^, {s^,-}™ J is a closed 
convex set. ■ 

We are now ready to establish that under some assumptions, any accumulation point of 
the sequence {x^} generated by the above exact SCP method is a KKT point of problem ([1]). 

Theorem 3.4 Let {(a;'^, s^, s^, {s^,}™;^, {s^^j^ILi)} he the sequence generated by the above exact 
SCP method. The following statements hold: 

(i) {x^} C T and {f{x^) + p{x^) — u{x^)} is monotonically nonincreasing. 

(ii) Suppose further that {x*, s}, <, {s*J^i, {sj;J™ i) is an accumulation point of{{x'', Sp s^, 
{s^.}™^, {s^.j^i)}- Assume that Slater's condition holds for the setC{x*, {s*J™i, {s*J™ J, 
t/iai is, there exists y E X such that 

9^{x*) + {s;f{y-x*) + ^\\y-x*\\^ + q^iy)-[v,{x*) + i.s:fiy-x*)] < 0, ^ = l,...,m. 

(14) 

Then, x* is a KKT point of problem ([1]). 

Proof (i) We know that x° G J-". Since x-*^ G {s°.}™ ^, {s°^}™ j^), it follows from 

Lemma 13.31 that x^ G J-'. By repeating this argument, we can conclude that {x*'} C J-'. In 
addition, notice that x'' G C(x'', {5^,}^^, {s^.}^^). Hence, we have 

/i(x^+^;x'',SpS,^) < h{x^]x^,s),s^^) = f {x^) + p{x^) - u{x^) . 

Since G 9-u(x^), we know that m(x^"*""'^) > m(x^) + (s^)'^(x^+^ — x^). Using this relation and 
Lemma [3. H one can see that 

/(x^+i) + p(x'=+^) - u(x^+^) < /l(x'=+l;x^4,s^). 

It then follows that 

/(x'^^^) + p(x'=+i) - m(x'^+1) < h{x^+^-x\s),sl) < f{x'')+p{x'')-u{x''). (15) 

Thus, {/(x^) +p(x^) — m(x^)} is monotonically nonincreasing. 

(ii) Let w := (x, 1, {s.J™ 1), := (x^ {^J-^, {s'^JZi), := (x*, {s*J™i, {s*JZi)- 

By the assumption, there exists a subsequence such that {(sp s^, w'^)}_ft: — )■ (sp s*, w*). We 
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first show that for any z G C[w*\ there exists G C(w^) such that {-z'^jx — ^ 2, where C is 
defined in (fT2|) . Indeed, let 

:= ^i(x) + - a;) + ^||?/ - xf + qi{y) - \vi{x) + - x)] Vi, 

and Q{y, w) := ti?), . . . , Qm{y, ui)). It follows from f lT^ that ^(y, ty*) < 0. Hence, there 

exists 6 > such that 

B{0;5)cg{y,w*) + 'ii+. (16) 

Notice that Q{y,w) is continuous in w and {w^^ji^: — )■ w*. Hence, when k & K is sufficiently 
large, \\G{y,w'') — ^(y, w*)|| < 6/2 holds. It immediately implies that, for sufficiently large 
keK, 

g{y, w*) - g{y, w^) + S(0; 5/2) C i3(0; 5). 
This relation together with (fT6|) yields that, for sufficiently large k & K, 

g{y,w^) + ^^ = g{y,w'') - giy,w*) + g{y,w*) + 3 g{y,w^)-g{y,w*) + B{0;S) 
^ giy,w'^)~giy,w*) + [g{y,w*)-giy,w'') + B{0;S/2)] = 6(0; S/2). 

Hence, y is also a generalized Slater point for the set C(w'^) when A; G -ft' is sufficiently large. In 
addition, it is not hard to verify that g{y, w^) is 3f?™-convex. Letting g{-) = g{-, w^), K, = 
Q = C{w^), X = X, and using Lemma [3.21 we obtain that, for sufficiently large k & K, 

dist(y,C(w'=)) < 26-'\\y-y\\dist{0,g{y,w'') + ^V^), \/yeX. (17) 

Let z G C{w*) be arbitrarily given, and let z'' = argmin{||2; — y\\ : y & C{w'^)}. Notice that 

y 

z ^ X . It then follows from f|T71) with y = z that, when k & K is sufficiently large, 

\\z^ - z\\=disi{z,C{w^)) < 25-^\\z-y\\dist{g{z,w''),-W:i). 

Since z G C{w*), we can observe that {dist(^(^, w^), -3fJ™)}i^ disi{g{z,w*), -W^) = 0. 
Using this relation and the above inequality, we obtain that {z'^}k — ^ z and z'^ G C{w''). 

Since {x^}k — ^ x*, by continuity we have {f{x^) + p{x^) — u{x'')}k f{x*) + p{x*) — 
u{x*). Notice that {/(x^) + p(x^) — u{x^)} is monotonically nonincreasing. Hence, we 
have f{x'') + p(x'^) — 'u(x'^) f{x*) + p{x*) — u{x*), which together with (fTSi) implies that 
h{x''~^^;x'',Sps'^) f{x*) + p{x*) -u{x*). Recall that x^^'^ G Argmin{/i(?/; x'', Sj, s^) : y G 
C{w'')}. Since z'^ G C{w^), we obtain that /i(x'^"'"^; x*^, Sj, s^) < h{z'^ ; x'' , Sp s^) . Upon taking 
limits on both sides of this inequality as /c G — )■ 00, we have 

/(x*) + J9(x*) - m(x*) < h{z; X*, s}, <), V;z G C(w*). 

In addition, since {x^} C J-" and {x^}i^ — )■ x*, we know that x* G J-", which yields x* G C(w*). 
Also, /(x*) + p(x*) - m(x*) = h{x*] X*, s*j, si). Therefore, 

X* G Argmin{/i(z;x*,s}-,s*) : 2; G C(w*)}. (18) 
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Since Slater's condition holds for C{w*), the first-order optimality condition of (fTSjl immedi- 
ately implies that x* is a KKT point of ([1]). ■ 



Remark. Since = V/(x''), G du{x^), Sg. = Vgi{x^), and s^^ e dvi{x^) for all z, we 
observe that if {x^} has an accumulation point, so is {sj, s^, {s^.}^^! {■s^ilE^i)}- Therefore, 
the first assumption in statement (ii) is mild. We next provide a sufficient condition for the 
second assumption to hold. In particular, we show that the assumption ( fT4l) holds if the 
following generalized Mangasarian-Fromovitz constraint qualification (MFCQ) holds at x*. ■ 

Proposition 3.5 Let x* be a point in T . If the generalized MFCQ holds at x* , that is, 
3(i G Tx{x*) such that 

g[{x*]d) + q[{x*]d)- inf s^d<0, Mi e A{x*). (19) 

s(idvi(x*) 

Then, (fT4|) holds at x* for s*g_ = V gi{x*) and every s*. G dvi{x*). 

Proof Let d be given above, s*. = Vgi{x*) and s*. G dvi{x*). Then, there exist a positive 
sequence {tk} i and a sequence {x^} C A* such that x'^ = x* +tkd+o(tk). For each i G ^(s*), 
we have that, for sufficiently large k, 

gi{x*) + {slJ^ix'' - X*) + ^\\x'' - x*f + qi{x^) - [vi{x*) + - x*)] 

= - X*) + ^\\x'' - x*p + qi{x'') - qi{x*) - {siy{x^ - x*) 

= tk{slfd + qi{x* + tkd) - qi{x*) - tk{slfd + o(tk) 

= tk[{slfd + q[{x*-d)-{slfd + o{l)] < tk[g[{x*-d) + q[{x*-d)- inf s'^d + o{l)] < 0, 

where the last inequality follows from ( TT9l) . In addition, for each i ^ A{x*), we know that 
gi{x*) + qi{x*) — Vi{x*) < 0. Notice that x'^ — )■ x* as — oo. Hence, for sufficiently large k, 
we have 

9^i^*) + islfix'^ - X*) + ^ llx'^ - X* f + q^ix") - b,(x) + (si fix' - X*)] < 0, z = 1, . . . , m. 



The above exact SCP method uses the global Lipschitz constants of V/ and Vf^j's, which 
may be too conservative. To improve its practical performance, we can use "local" Lipschitz 
constants that are updated dynamically. In addition, the above method is a monotone method 
since {f{x') +p{x'') — u{x')} is nonincreasing. As mentioned in [TDl IH ESI E], nonmonotone 
methods generally outperform monotone counterparts for many nonlinear programming prob- 
lems. We next propose a variant of the exact SCP in which "local" Lipschitz constants and 
nonmonotone scheme are used. Before proceeding, we introduce some notations as follows. 
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For each x G J-", //, /g. G 3?, S/, s^, s^,^, G 3?" for i = 1, . . . , m, we define 



(20) 



h{y;xJf,Sf,Su) = f{x) + s'j:{y-x) + —\\y-xf+p{y)-[u{x) + sl{y-x)], 
F{x) := /(x) + p(x) — m(x). 

We are now ready to present a variant of the above exact SCP method. 

A variant of exact SCP method for ([T]): 

Choose parameters c > 0, < L^in < L^a^, t > 1, and integer M > 0. Set k = and choose 
an arbitrary x° G J-". 

1) Compute = Wf\x^), sj; G du{x''), Sg^ = Wgii^x^), 4, ^ dvi{x'') for all i. 

2) Choose °, Igf G [//min, -^max] arbitrarily, and set = ° and Ig. = Igf for all i. 

3) Find 

x'^+i = argmin{%;x^/J,4,.t) : y G C{x\ {l'jT=iA4Mid<}T=i)}- (21) 
3a) If x'^+i G and 

F(x'=+^) < max Ffx^ - -||a;^+^ - (22) 

^ ^ - [k-M] + <i<k ^ ^ 2 " " ^ ^ 

holds, go to step 4). 
3b) If x'^"*"^ ^ J^, set Ig, i- rig, for all i and go to step 3). 
3c) If ([22]) does not hold, set I'j ^ rl) and go to step 3). 

4) Set A; <(— /c + 1 and go to step 1). 
end 

Remark. 

(i) When M = 0, the above method becomes a monotone method. 

(ii) In practical computation, can be updated by the similar strategy as used in 
mi], that is, 

~ -"^^-^ |-^min; mill l^-^max; ^^^^ I I ; 

llf = max|L^i„,min|L^ax,^S^}}, Vz, 

where Ax = x^ — x^~^, Af = V f{x^) — V/(x'''~^), and Agi = Vgi{x^) — V gi{x^^^) for 
all i. 
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(iii) I'} and {t}Z 

I can be updated by some other strategies. For example 
and {/J^ 



1) we may update iH and simultaneously, that is, steps 3b) and 3c) can be 



replaced by: 

if x'^^^ ^ J" or ( l22l) does not hold, set ^ r/j and ^ r/^. for all i; 

2) in step 3b), each lg_ can be updated individually. In particular, for each i, we can 
update lg_ only if the ith constraint of ([1]) is violated at x'''^^, that is, gi{x^~^^) + 
qi{x'^~^^) - Vi{x''^^) > 0. 



We first show that for each outer iteration, its number of inner iterations is finite. 

Theorem 3.6 At each kth outer iteration, its associated inner iterations terminate after at 
most 

log(L/ + c) + log(maxLgJ - 2 log(2Lmin) 

+ 4 



logr 



(23) 



loops. 



Proof. Let Vj- and V^^ denote the final value of I'j- and Ig. at the kth outer iteration, respec- 
tively. Note that h{-; x^, l^, s'j, s^) is a strongly convex function with modulus > 0. It then 
follows from fl2T]) that 

Fix'') = f{x'')+p{x'')-u{x'') = x^ /J, 4, s^) > /^(x'=+^x^/),4,st) + ^||x'^+^-x'^||2. 

Since G du{x''), we know that u{x''^^) > u{x'') + {s'^)'^ {x'^^^ — x''). Using this relation and 
Lemma [3. H one can see that 

F(x'^+i) = /(x''+i) + p(x^+^) - n(x'=+^) < h{x''+^;x\l'},s%sl) + ^^-^\\x''+' -x'^f. 
The above two inequahties yield 

F(x'=+^) < F{x'')-{l'}-^)\\x''+' -x'^Wl < max F{x') - {l'} - ^)\\x''+' - x'^g. 

■' 2 [fc-M] + <j<A: •' 2 



Similarly, one can show that 

^7,(x^+i) + g,(x^+i)-t;,(x^+i) < g^(x'') + q^(x'') - v,{x') ~ {l';^ - ^)\\x'^' ~ x%, Vz, 



which together with x G J-" implies that 
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Hence, x'^^^ G T and ( 122|) holds whenever > {Lf + c)/2 and min/^, > (maxLg.)/2, which, 
together with the definitions of 4 and l^., imphes that Ik/r < (Lj + c)/2 and min J^./r < 
(maxLg-)/2, that is, 4 < T(Lf + c)/2 and minl^. < r(maxL„.)/2. Let nH and denote the 
number of inner iterations for updating and Ig. at the kth outer iteration. Then, we have 

Ljnin^"^"^ < (minLg'°)r"s~-^ = minJ^. < r(max Lg-)/2. 

Hence, the total number of inner iterations, + n^, is bounded above by the quantity given 
in fl23|) and the conclusion holds. ■ 

We next establish that under some assumptions, any accumulation point of the sequence 
{x^} generated by the above variant of the exact SCP method is a KKT point of problem ([T]). 

Theorem 3.7 Let {{x^, Sp s^, {SgJ^i, {SyJ^i)} be the sequence generated by the above vari- 
ant of the exact SCP method. Assume that F{x) := f (x) + p{x) — u{x) is uniformly continuous 
in the level set C = {x e J' : F{x) < Suppose that {x\ I}, {ll}T=i, s}, <, {s;JZi, {slMi) 

is an accumulation point o/ {(x^, /j, {Z^.}^]^, Sj, s^, {s^^}^]^, {s^^}^ J}. Then the following 
statements hold: 

(i) - x^ll and f{x^) + p{x^) - u{x^) -> f{x*) + p{x*) - u{x*). 

(ii) Suppose further that Slater's condition holds for the constraint setC{x*, {lg.}^i, {s*.}™ i, {Kji^i)) 
that is, there exists y E X such that 

+ + + + < 0, z = l,...,m. (24) 

Then, x* is a KKT point of problem ([1]). 

Proof, (i) By the definition of a;'^, we observe that {x'^} C C. Let := x'^^^ — x'^, and 
l{k) an integer between [k — M]+ and k such that 

= max{F(xO : [k - M]+ <i<k}, Wk > 0. 

It follows from fl22]) that F{x''^^) < F{x^'^^'>) for all A; > 0, which together with the definition 
of l{k) implies that {F{x^^^^)} is monotonically nonincreasing. Further, by continuity of F 
and {x^}k — ^ x* , we know that {F{x'')}k — ^ F{x*). This together with the fact F{x'-^''^) > 
F{x^) implies that {F{x^^^^)}k is bounded below. Using this result and the monotonicity of 
we see that is bounded below. Hence, there exists some F* E 'Si such 

that 

lim = F*. (25) 

k—¥oo 

We can prove by induction that the following limits hold for all j > 1: 

lim = 0, lim F(x'(*'')-^) = F*. (26) 
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Indeed, replacing k by l{k) — 1 in ( 122|) and using the definition of l{k), we obtain that 

which together with ( |25l) imphes that hnifc^oo ci'*^^-'"^ = 0. Using this relation, (l25i) and uniform 
continuity of F in £, we have 

lim F{x^^^^-^) = lim F(a;'('=) - ci'^^')"^) = lim F{x^^''^) = F*. 

k—^oo k—^oo fc— >oo 

Therefore, (l26l) holds for j = 1. Now, we assume that ( |26l) holds for j. We need to show that 
it also holds for j + 1. Replacing k hj l{k) — j — 1 in (1221) and using the definition of l{k), we 
have 

which, together with (125|) and the induction assumption limfc_^oo F{x^'^^'>~'^) = F*, implies that 
limfc_^oo 0^^^^''""'"^ = 0. Using this result, limk^^ F(x^^''^~^) = F* and uniform continuity of F 
in £, we see that limfc^oo -^(a;'*-'^-'"-'"^) = F*. Hence, ( l26l) holds for j + 1. It then follows from 
the induction that ( l26l) holds for all j > 1. Further, by the definition of l{k), we see that for 
k > M + 1, k — M — 1 = l{k) — j for some 1 < j < M + 1, which together with the first limit 
in fl26|) . implies that limj^^ooC^'^ = hnifc^oo = 0. Additionally, we observe that 

Ik 

where 1^ = /(fc) — (fc — M — 1) < M + 1. Using the above identity, (126|) . and uniform 
continuity of F in £, we see that limfc^oo -^(a^'^) = linife-i-oo F(a;'^~^^~^) = F*, which, together 
with {F{x^)}k — )■ F(x*), implies that F[x^) — )■ F(x*). Hence, the statement (i) holds. 

(ii) Let w := ix,{ljT=iAsjT=iAsvJT=i), := (^', {^,',^1, (O^i)' ^* ■= 

(x*, {/*.}™ {s*.}^]^, {s*.}™ ]^). By the assumption, there exists a subsequence i^' such that 
{{lpSf,s'^,w'')}K {l*f,SpSl,w*). We first show that for any z G C{w*), there exists 
z'^ G C(w'^) such that {z'^}k — ^ -2, where C is defined in ( l20l) . Indeed, let 

Qiiy,w) := gi{x) + s^iy - x) + y lb - a;f + gi(?/) - [vi{x) + s'^^{y - x)] Vi, 

and Q{y,w) := {Qi{y,w),...,Qm{y,w)). Notice that Q{y,w) is continuous in w. Using this 
fact, (Ell), Lemma [3.21 and the similar arguments as in the proof of Theorem 13.41 (ii), one can 
show that there exists some 6 > such that for sufficiently large k & K, 

dist(y,C(«;^)) < 26-^\\y-y\\dist{0,g{y,w'') + ^'^), G A". (27) 

Let z G C{w*) be arbitrarily given, and let z^ = argmin{||2; — y\\ : y G C(w^)}. Clearly, z & X 

y 

and dist(^(z, w*), — 3?™) = 0. Using these facts and letting y = z in (l27j) . one can obtain that 
{z'']k z and z^ G C{w^). 
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Recall from statement (i) that \\x^^^ — x^\\ — t- 0. Since {x''}k x*, it then follows that 
l^fc+i _j, ^* jk (^ignote the final value of at the kth outer iteration. From the proof of 
Theorem I3.6[ we know that P G [Lmin, r(L/ + c)/2]. Using these facts and {F{x^)} — )■ 
we observe that 

{h{x'-'';x\V},s'f,st)}K ^ F{x*). 

Recall that x'^'^^ = a.Tgmm{h{y; x^ ,Vj, s'^) : y G C{w'')}. Since 2;^ G C(w^), we have 
jk^ ^k^ ^k^ ^ h(^z^-^ x^ , P, Sj, s^). Upou taking limits on both sides of this inequality 
as G -fC — 7- 00, we obtain that 

Fix*)<Hz;x*,l},s},s:), yzeCiw*). 

In addition, we know that G J", which implies that a;* G C{w*). Aho,F{x*) = h{x* ; x* , Ij , s*p si) . 
Hence, we have 

X* G ATgmm{h{z; x\ 1}, s}, <) : 2 G C{w*)}. (28) 

Since Slater's condition holds for C{w*), the first-order optimality condition of (!28|) immedi- 
ately implies that x* is a KKT point of ([1]). ■ 

Remark. For M = 0, Theorem 13.71 still holds without the uniform continuity of F{x) in 
the level set £ = {x G : F{x) < ■ 

4 Inexact sequential convex programming approach 

In this section we study an inexact SCP method for solving ([1]) in which subproblem (|T3|) is 
assumed to be solved inexactly. 

Throughout this section we assume that some constraint qualification holds for each sub- 
problem ( 1T3|) . Therefore, if ( 1T3|) is solved exactly, there exists A'^ > 0, Sp'^^ G dpi^x^'^^), 
Sg^^ G dqi{x''~^^) for all i such that the following KKT conditions hold: 

m 

\\Vx{x''+^ - [sj + - x'') + s^+i - + E ^^(4 + LgXx''^^ - x'') + - 4)]) - x'^+i = 0, 

i=l * 

Qiix'') + - x'') + ^llx'^+i - x'^f + - [t;i(x^) + (4)^(x^+^ - x'^)] < 0, Vi, 

(^i(x'=) + (4)^(x^+^ - x^) + ^l^llx'^+i - x^-f + gi(x^+i) - [t;i(x'=) + «)^(x^+^ - x^)]) > Vi 

We now assume that subproblem (fT3l) is solved inexactly, that is, there exists some A^ > 
such that (x'^"^^,A'^) satisfies the following approximate KKT conditions: 

m 

_ + Lf{x'+' - x'^) + .J+i -st + J2 (4 + ^..(^'''' - + 4^' - 4)]) - ^'^1 < ^fc' (29) 

i=l 

gii^') + ^ix'^' - + - + q^{x'+') - h{x') + istfix'^' - x'^)] < e,, W^, (30) 

AtX^7.(x^) + (4)^(x'=+^ - x'^) + ^llx'^+i - x'^ir + q,{x'^') - [v,{x') + (4)^(x^+^ - x^')]) > -e, V^.(31) 
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The resulting inexact SCP method is presented as follows. 

Inexact sequential convex programming method for ([T]): 

Let E X he arbitrarily chosen, and > be given. Set A; = 0. 

1) Compute s'j = V f{x^), G du{x''), Sg^ = Vgi{x^), s^. G dvi{x'') for all i. 

2) Find an approximate solution x^^^ to problem f|T3|) such that f l29|) - fl3T|) hold for some 

> gk+i g gfc+i e for all i. 

3) Set <«— + 1 and go to step 1). 
end 

Theorem 4.1 Let {x'^} G X be generated by the above inexact SCP method. Suppose that 
Lf > 0, {x^} and {X^} are bounded . Then the following statements hold: 

(i) if —7- and \\x'^^^ — — )■ 0, then any accumulation point of {x''} is a KKT point of 

©; 

(ii) if J2 < oo and 

k 

m 

J2J2^X'l'''-Xmg.{x'''') + q^{x'^')-v,{x'^')]<oo, (32) 

k i=l 

then any accumulation point of {x^} is a KKT point of (Q. 
Proof (i) Notice that 

gi{x''+') < gi{x'') + {s';f{x''+^-x'') + ^\\x''+'~x''\\^,yt, (33) 
v^ix''^') > v,{x'') + {stfix'-'' - x'), yt. (34) 

In view of ([301), (IM]) and (EH), we have 

gi{x'+') + q^{x'^')-v,{x'+')<e,. (35) 

By the assumption that {x'^} is bounded, we know that {sj, Sp"'"^ s^, {SgJ^i, {Sq^^}iLi^ {-^vji^i} 
is bounded. Let x* E X he any accumulation point of {x^}. Then there exists a subsequence K 
such that {x''}k — ^ x*. Due to the boundedness of {A^}, {s'j}, {s^}, {Sg.}, {Sq^^} and 

{s^.}, by passing to a subsequence if necessary, we can assume that {X^}k A*, — > 
{Sp'^^}K -> s;, {st}K si, {s^gjK s*g^, {s^g+^}K ^ and {s^Jx < for some A* > 0, 
= Vf{x*), s* e dp{x*), s* e du{x*), s*g. = Vgi{x*), s*. e dqi{x*) and s*. G dvi{x*). Since 
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Il^fe+i _ ^.^ii _i. Q g^Yid {x''}k — > X*, we have {x'''^^}k x*. Using the assumption e/c — )■ and 
taking hmit on both sides of ( 129|) . (!35|) and (1311) . we obtain that 

m 

Vx{x* - [s} + - < + E K{sl + si - s*J]) - X* = 0, (36) 

i=l 

gi{x*) + q,{x*) ~ v,{x*) < 0, (37) 

K[9^i^*)+q^i^*)-V^i^*)]>0. (38) 

The relation fl36l) implies that 

m 

-(.} + s; - < + 5^ A*(s;^ + si - <)) G Ar;,(x*). 
i=l 

In addition, it follows from A* > 0, (EZD and ([M]) that 

X:[gi{x*) + qi{x*) - Vi{x*)] = 0, Vz. 

Hence, x* is a KKT point of (JT]). 
(ii) For convenience, let 

C{x; x^, A^) = /(x^) + (s^)^(x - x^) + -^||x - x''^ + p{x) - [■u(x^) + (s^)^(x - x'')] 

+ E \'(^?^(a;'') + (sy (a; - x^O + %^||x - x'^f + Qiix) - [viix'') + (4)^(x 

i=l 

m 

4+^ = 4 + L;(x^+i - x'^) + .J+i -st + E Af (4 + L,,(x^+i - x'^) + - 4). 

i=l 

It follows from (l29l) that there exists w'^ such that \\w^\\ < and 

P;^(x'=+l - 4+1) =x'=+l+W^ 

which implies that 



(s 



k+1 ^ ^k^T^^k+l _^k^ ^k^ < Q_ 



Hence, 

(4+i)^(x'^+i - x'') < (w'^fix'' - x'^+i - 4+1 - «;'=). (39) 

Recall that {sp Sp'^^, s'^, {Sg.}^^, {Sg^^}^^, {s^.}^^} is bounded, which together with the 
boundedness of {A'^} implies that {s^+i} is bounded. It then follows from (139|) that 



(4+1)^ (x'^+i - x'=) < elkll < (40) 

for some constant ^ > 0. In addition, we observe that £(-;x^,A'^) is strongly convex with 
modular Lj + AfL^, and s^+i G dC{x''+^; x^ A'^). Thus, we have 

^ m 

£(x^ x^ A^) > £(x^+i; x^ A^) + (4+i)^(x'^ - x'^+i) + -(Lj + ^ AfL<,J||x''+i - x^f . (41) 



11 fc+1 k\\2 



Notice that 

Using these inequahties, f p3|) . flM|) . and the definition of £, we have 

m 

m 

It then follows from this inequality, ( HUi) and (HTj) that 

i=l 

Hence, we obtain that 



^llx'^+^-x'^f = 0(£(x°;x^A°)-inf£(x^x^A'=) + ^efc) 

k k 

m 

Due to the boundedness of {x''} and {A'^}, we see that {C{x^; x'', A'^)} is bounded. Using this 
fact, (jl2]), ([32]) and J2^k < oo, we see that Y,k \\x''~^^-x^\\'^ is finite, and hence 0. 
In addition, — )■ due to < oo. The conclusion of this statement immediately follows 
from statement (i). ■ 

Remark. Condition (l32l) can be interpreted as follows. Let Q{X) denote the Lagrange dual 
function of ([T]), g{x^^^) = {gi{x''+^ , . . . , gmix''^^))'^ , = (gi(a;''+\ . . . , 5^(2;''^^))^ and 

f (x'^^^) = {vi{x^^^, . . . ,Vm{x''^'^))'^ ■ Then, g{x^^^) + — v{x^^^) can be viewed as an 

approximate subgradient of Q at A'^^^. If it is a "good" approximation, one can obtain from 
the concavity of Q that 

m 

^(A^^ - X^)Mx'+') + q.{x'+') - v,{x'+')] = 0{Q{X'^') - Q{X')), 
1=1 

and hence, 

m 

E - ^fm^'^') + - M^'^')] = o(supg(A) - g(A°)) < 00. 
k i=i 
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